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DETAILED ACTION 
Priority 

1 . Receipt is acknowledged of papers submitted under 35 U.S.C. 1 19(aHd), which 
papers have been placed of record in the file. 

Response to Amendment 

2. Receipt of Applicant's Amendment, filed on 12/1 1/2006, is acknowledged. The 
amendment includes the submission of a new specification and abstract, the addition of 
claims 9-12, and the amending of claims 1 , and 6-8. 

Claim Objections 

3. The objections raised in the office action mailed 08/10/2006 have been overcome 
by applicant's amendments received on 1 2/1 1/06. 

Specification 

4. Receipt of Applicant's substitute specification filed on 12/1 1/06 is acknowledged. 
Accordingly, the substitute specification is accepted by the examiner for the instant 
application. 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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6. Claims 1 -2, and 6-8 are rejected under 35 U.S.C. 1 03(a) as being unpatentable 
over Hyon (U.S. PGPUB 2002/0077135) and in view of Baker (U.S. Patent 6,546,417). 

7. Regarding claim 1 , Hyon teaches a display device comprising: 

A) a first storage portion for storing beforehand a character code for specifying each 
character in said text and character shape data corresponding to said character code in 
a correlated manner (Hyon, Paragraphs 41-42, Figure 4); 

B) a second storage portion for storing an image code for specifying said registered 
image and registered image data corresponding to said image code In a correlated 
manner according to registration processing by a user (Hyon, Paragraphs 25 and 44, 
Figure 2); 

C) the image code being not stored in the second storage portion beforehand and 
stored externally bv a user (Paragraph 44); 

D) a display output portion for outputting said text and said registered image (Hyon, 
Paragraph 21, Figure 2); and 

E) a display control portion for causing said display output portion to output 
corresponding said text and said registered image based on display data containing a 
series of said character code, text attribute data, and said image code (Hyon, 
Paragraphs 21 and 42); 

The examiner notes that Hyon teaches "a first storage portion for storing 
beforehand a character code for specifying each character in said text and 
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character shape data corresponding to said character code in a correlated 
manner" as "the user can input a text including typical characters, special characters, 
or emoticons within the range of a transmittable SMS message, by changing input 
modes" (Paragraph 41). The examiner further notes that Hyon teaches "a second 
storage portion for storing an image code for specifying said registered image 
and registered image data corresponding to said image code in a correlated 
manner according to registration processing by a user" as "storage 18 stores 
oriental or occidental emoticons according to the cultural area of a user" (Paragraph 
25). The examiner further notes that Hyon teaches " the image code being not stored 
in the second storage portion beforehand and stored externally by a user " as "In 
another embodiment, the user can add hieroglyphics to basic emoticons stored by a 
manufacturer. The hieroglyphics can be stored in three ways: the user directly stores 
them, receives them from a base station, and the stores them, or downloads them from 
the Internet" (Paragraph 44). The examiner further notes that Hyon teaches "a display 
output portion for outputting said text and said registered image" as "a display 16 
outputs display data and text messages generated in the mobile terminal. An LCD 
(Liquid Crystal Display) can be used as the display 16" (Paragraph 21 ). The examiner 
further notes that Hyon teaches "a display control portion (10) for causing said 
display output portion to output corresponding said text and said registered 
image based on display data containing a series of said character code, text 
attribute data, and said image code" as "a display 16 outputs display data and text 
messages generated in the mobile terminal. An LCD (Liquid Crystal Display) can be 
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used as the display 16" (Paragraph 21) and "After an intended text is completed, the 
user instructs the mobile terminal to transmit the SMS message including the 
emoticon...the mobile terminal transmits the stored message" (Paragraph 42). The 
examiner further notes that it is common knowledge that when text messages are 
received via a device, the entire message is displayed at once. 

Hyon does not explicitly teach: 
F) said display control portion having image transforming means for transforming said 
registered image to be displayed according to said text attribute data. 

Baker, however, teaches "said display control portion having image 
transforming means for transforming said registered Image to be displayed 
according to said text attribute data" as "in order to accommodate the use of 
different size fonts in the mailbox display, means for scaling the size of the icon 
graphics are also provided... at least one image for each icon is stored, the icon most 
closely matching the point size of the font is chosen and then scaled as needed to 
better match the font point size" (Column 8, lines 26-40). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Baker's would have allowed Hyon's to provide a method for allowing for scalable icons 
to accompany texts with specified and varied fonts in order to easily associate an icon 
to a particular sentence, as noted by Baker (Column 5, lines 40-55). 

Regarding claim 2, Hyon does not explicitly teach a display device comprising: 
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A) wherein said text attribute data contains size attribute data indicating a ctiaracter 
size of ttie corresponding text (Balder, Column 8, lines 26-40); and 

B) said image transforming' means scales up/down said registered image according to 
said size attribute data (Bal<er, Column 8, lines 26-40). 

Baker, however, teaches "wherein said text attribute data contains size 
attribute data indicating a character size of the corresponding text" as "in order to 
accommodate the use of different size fonts in the mailbox display, means for scaling 
the size of the icon graphics are also provided... at least one image for each icon is 
stored, the icon most closely matching the point size of the font is chosen and then 
scaled as needed to better match the font point size" (Column 8, lines 26-40) and "said 
image transforming means scales up/down said registered image according to 
said size attribute data" as "in order to accommodate the use of different size fonts in 
the mailbox display, means for scaling the size of the icon graphics are also 
provided... at least one image for each icon is stored, the icon most closely matching the 
point size of the font is chosen and then scaled as needed to better match the font point 
size" (Column 8, lines 26-40) 

It would have been obvious to one of ordinary skill in the art at the time the 
Invention was made to combine the teachings of the cited references because teaching 
Baker's would have allowed Hyon's to provide a method for allowing for scalable icons 
to accompany texts with specified and varied fonts In order to easily associate an icon 
to a particular sentence, as noted by Baker (Column 5, lines 40-55). 
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Regarding claim 6, Hyon teaches a metliod comprising: 

A) storing an image code for specifying said registered image and registered Image 
data corresponding to said Image code In a correlated manner according to registration 
processing by a user (Hyon, Paragraphs 25 and 44, Figure 2); 

B) the image code being not stored In the second storage portion beforehand and 
stored externally by a user (Paragraph 44); and 

C) displaying said text and said registered image simultaneously based on said 
transformed registered image, and said text attribute data and the character code for 
specifying each character in said text, and character shape data corresponding to said 
character code stored beforehand in a correlated manner (Hyon, Paragraphs 21 and 
42). 

The examiner notes that Hyon teaches "storing an image code for specifying 
said registered image and registered image data corresponding to said image 
code in a correlated manner according to registration processing by a user" as 

"storage 18 stores oriental or occidental emotlcons according to the cultural area of a 
user" (Paragraph 25). The examiner further notes that Hyon teaches " the image code 
being not stored in the second storage portion beforehand and stored externally 
by a user " as "In another embodiment, the user can add hieroglyphics to basic 
emoticons stored by a manufacturer. The hieroglyphics can be stored in three ways: 
the user directly stores them, receiyes them from a base station, and the stores them, or 
downloads them from the Internet" (Paragraph 44). The examiner further notes that 
Hyon teaches "displaying said text and said registered image simultaneously 
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based on said transformed registered image, and said text attribute data and the 
character code for specifying each character in said text, and character shape 
data corresponding to said character code stored beforehand in a correlated 
manner" as "a display 16 outputs display data and text messages generated in the 
mobile terminal. An LCD (Liquid Crystal Display) can be used as the display 16" 
(Paragraph 21) and "After an intended text is completed, the user instructs the mobile 
terminal to transmit the SMS message including the emoticon...the mobile terminal 
transmits the stored message" (Paragraph 42). The examiner further notes that it is 
common knowledge that when text messages are received via a device, the entire 
message is displayed at once. 

Hyon does not explicitly teach: 
D) with respect to display data containing a series of a character code, text attribute 
data, and said image code, transforming said registered image to be displayed 
according to said text attribute data. 

Baker, however, teaches "with respect to display data containing a series of 
a character code, text attribute data, and said image code, transforming said 
registered image to be displayed according to said text attribute data" as "in order 
to accommodate the use of different size fonts in the mailbox display, means for scaling 
the size of the icon graphics are also provided... at least one image for each icon is 
stored, the icon most closely matching the point size of the font is chosen and then 
scaled as needed to better match the font point size" (Column 8, lines 26-40). 
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It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Baker's would have allowed Hyon's to provide a method for allowing for scalable icons 
to accompany texts with specified and varied fonts in order to easily associate an icon 
to a particular sentence, as noted by Baker (Column 5, lines 40-55). 

Regarding claim 7, Hyon teaches a viewer program comprising: 

A) storing an image code for specifying said registered image and registered image 
data corresponding to said image code in a correlated manner according to registration 
processing by a user (Hyon, Paragraphs 25 and 44, Figure 2); 

B) the image code being not stored in the second storage portion beforehand and 
stored externally bv a user (Paragraph 44); and 

C) displaying said text and said registered image simultaneously based on said 
transformed registered image, and said text attribute data and the character code for 
specifying each character in said text, and character shape data corresponding to said 
character code stored beforehand in a correlated manner (Hyon, Paragraphs 21 and 

42). 

The examiner notes that Hyon teaches "storing an image code for specifying 
said registered image and registered image data corresponding to said image 
code in a correlated manner according to registration processing by a user" as 

"storage 18 stores oriental or occidental emoticons according to the cultural area of a 
user" (Paragraph 25). The examiner further notes that Hyon teaches " the image code 
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being not stored in the second storage portion beforehand and stored externally 
by a user " as "In another embodiment, the user can add hieroglyphics to basic 
emoticons stored by a manufacturer. The hieroglyphics can be stored in three ways: 
the user directly stores them, receives them from a base station, and the stores them, or 
downloads them from the Internet" (Paragraph 44). The examiner further notes that 
Hyon teaches ''displaying said text and said registered image simultaneously 
based on said transformed registered image, and said text attribute data and the 
character code for specifying each character in said text, and character shape 
data corresponding to said character code stored beforehand in a correlated 
manner" as "a display 16 outputs display data and text messages generated in the 
mobile terminal. An LCD (Liquid Crystal Display) can be used as the display 16" 
(Paragraph 21 ).and "After an intended text is completed, the user instructs the mobile 
terminal to transmit the SMS message including the emoticon...the mobile terminal 
transmits the stored message" (Paragraph 42). The examiner further notes that it is 
common knowledge that when text messages are received via a device, the entire 
message is displayed at once. 

Hyon does not explicitly teach: 
D) with respect to display data containing a series of a character code, text attribute 
data, and said image code, transforming said registered image to be displayed 
according to said text attribute data. 

Baker, however, teaches "with respect to display data containing a series of 
a character code, text attribute data, and said Image code, transforming said 
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registered image to be displayed according to said text attribute data" as "in order 
to accommodate the use of different size fonts in the mailbox display, means for scaling 
the size of the icon graphics are also provided... at least one image for each icon is 
stored, the icon most closely matching the point size of the font is chosen and then 
scaled as needed to better match the font point size" (Column 8, lines 26-40). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Baiter's would have allowed Hyon's to provide a method for allowing for scalable icons 
to accompany texts with specified and varied fonts in order to easily associate an icon 
to a particular sentence, as noted by Baker (Column 5, lines 40-55). 

Regarding claim 8, Hyon teaches a computer readable recording medium 
comprising: 

A) storing an image code for specifying said registered image and registered image 
data corresponding to said image code in a con-elated manner according to registration 
processing by a user (Hyon, Paragraphs 25 and 44, Figure 2); 

B) the image code being not stored in the second storage portion beforehand and 
stored externally bv a user (Paragraph 44); and 

C) displaying said text and said registered image simultaneously based on said 
transformed registered image, and said text attribute data and the character code for 
specifying each character in said text, and character shape data corresponding to said 
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character code stored beforehand in a correlated manner (Hyon, Paragraphs 21 and 
42). 

The examiner notes that Hyon teaches "storing an image code for specifying 
said registered image and registered image data corresponding to said image 
code in a correlated manner according to registration processing by a user" as 

"storage 18 stores oriental or occidental emoticons according to the cultural area of a 
user" (Paragraph 25). The examiner further notes that Hyon teaches " the image code 
being not stored in the second storage portion beforehand and stored externally 
by a user " as "In another embodiment, the user can add hieroglyphics to basic 
emoticons stored by a manufacturer. The hieroglyphics can be stored in three ways: 
the user directly stores them, receives them from a base station, and the stores them, or 
downloads them from the Internet" (Paragraph 44). The examiner further notes that 
Hyon teaches "displaying said text and said registered image simultaneously 
based on said transformed registered image, and said text attribute data and the 
character code for specifying each character in said text, and character shape 
data corresponding to said character code stored beforehand in a correlated 
manner" as "a display 16 outputs display data and text messages generated in the 
mobile tenninal. An LCD (Liquid Crystal Display) can be used as the display 16" 
(Paragraph 21 ) and "After an intended text is completed, the user instructs the mobile 
terminal to transmit the SMS message including the emoticon...the mobile temiinal 
transmits the stored message" (Paragraph 42). The examiner further notes that it is 
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common knowledge that when text messages are received via a device, the entire 
message is displayed at once. 

Hyon does not explicitly teach: 
D) with respect to display data containing a series of a character code, text attribute 
data, and said image code, transforming said registered image to be displayed 
according to said text attribute data. 

Baker, however, teaches "with respect to display data containing a series of 
a character code, text attribute data, and said image code, transforming said 
registered image to be displayed according to said text attribute data" as ' in order 
to accommodate the use of different size fonts in the mailbox display, means for scaling 
the size of the icon graphics are also provided... at least one image for each icon is 
stored, the icon most closely matching the point size of the font is chosen and then 
scaled as needed to better match the font point size" (Column 8, lines 26-40). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Baker's would have allowed Hyon's to provide a method for allowing for scalable icons 
to accompany texts with specified and varied fonts in order to easily associate an icon 
to a particular sentence, as noted by Baker (Column 5, lines 40-55). 

8. Claims 3-5, and 9-12 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Hyon (U.S. PGPUB 2002/00771 35) and in view of Baker (U.S. Patent 6,546,41 7) 
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as applied to claims 1-2, and 6-8 and further in view of Ostermann et al. (U.S. Patent 

6,990,452). 

9. Regarding claim 3, Hyon and Baker do not explicitly teach a display device 
comprising: 

A) wherein said text attribute data contains color attribute data indicating at least a fore 
color of a corresponding text; and 

B) said image transforming means converts a color of said registered image according 
to said color attribute data. 

Ostermann, however, teaches "wherein said text attribute data contains 
color attribute data Indicating at least a fore color of a corresponding text" as 
"The sender can associate typed words with an emoticon by underlining, coloring, 
highlighting, or by any other means. For example, the method may comprise providing 
the sender an option to assign a color to the at least typed one word such that the 
chosen emoticon begins to be presented by the animated entity to the recipient at the 
first typed word with the assigned color and the chosen emoticon presentation by the 
animated entity ends at the last typed word with the assigned color" (Column 1 1 , lines 
43-50) and "said image transforming means converts a color of said registered 
image according to said color attribute data" as "The sender can associate typed 
words with an emoticon by underlining, coloring, highlighting, or by any other means. 
For example, the method may comprise providing the sender an option to assign a color 
to the at least typed one word such that the chosen emoticon begins to be presented by 
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the animated entity to tine recipient at the first typed word with the assigned color and 
the chosen emoticon presentation by the animated entity ends at the last typed word 
with the assigned color" (Column 1 1 , lines 43-50). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Ostermann's would have allowed Hyon's and Baker's to provide a method to allow 
the ability to insert a customized emoticon or specified image by a single button click, as 
noted by Ostermann (Column 3, lines 35-54). 

Regarding claim 4, Hyon and Baker do not explicitly teach a display device 
comprising: 

A) wherein said registered is a gray image, said image transforming means converts 
each pixel into a color made by mixing the fore color and a back color of said text at a 
ratio according to a pixel value. 

Ostermann, however, teaches "wherein said registered is a gray image, said 
image transforming means converts each pixel into a color made by mixing the 
fore color and a back color of said text at a ratio according to a pixel value" as 
"The increased intensity of the emoticon may be accomplished by changing the icon 
from black-on-white background to black-on-colored background (such as red or yellow) 
where the intensity of the background color reflects the amplitude" (Column 9, lines 43- 
67) and "The sender can associate typed words with an emoticon by underlining, 
coloring, highlighting, or by any other means. For example, the method may comprise 
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providing the sender an option to assign a color to the at least typed one word such that 
the chosen emoticon begins to be presented by the animated entity to the recipient at 
the first typed word with the assigned color and the chosen emoticon presentation by 
the animated entity ends at the last typed word with the assigned color" (Column 1 1 , 
lines 43-50) 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Ostermann's would have allowed Hyon's and Baker's to provide a method to allow 
the ability to insert a customized emoticon or specified image by a single button click, as 
noted by Ostermann (Column 3, lines 35-54). 

Regarding claim 5, Hyon and Baker do not explicitly teach a display device 
comprising: 

A) wherein said text attribute data contains decoration attribute data indicating a type of 
a decoration applied to a corresponding text; and 

8) said image transforming means decorates said registered image according to said 
decoration attribute data. 

Ostermann, however, teaches "wherein said text attribute data contains 
decoration attribute data indicating a type of a decoration applied to a 
corresponding text" as "The sender can associate typed words with an emoticon by 
underlining, coloring, highlighting, or by any other means... In this case, in a sentence 
such as "Hi John, :-) are vou pleased that the stock market is up ?" the underlining 
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represents the highlighting wherein the sender chooses to begin the smile at the 
beginning of the word "are" and to continue the smile through the word "up". The 
method comprises receiving the indicated duration of the emoticon and presenting the 
chosen duration of the emoticon" (Column 11, lines 43-61) and "said image 
transforming means decorates said registered image according to said 
decoration attribute data" as "The sender can associate typed words with an 
emoticon by underlining, coloring, highlighting, or by any other means... In this case, in a 
sentence such as "Hi John, :-) are you pleased that the stock market is up ?" the 
underlining represents the highlighting wherein the sender chooses to begin the smile at 
the beginning of the word "are" and to continue the smile through the word "up". The 
method comprises receiving the indicated duration of the emoticon and presenting the 
chosen duration of the emoticon" (Column 1 1 , lines 43-61 ). 

It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to combine the teachings of the cited references because teaching 
Ostermann's would have allowed Hyon's and Baker's to provide a method to allow 
the ability to insert a customized emoticon or specified image by a single button click, as 
noted by Ostermann (Column 3, lines 35-54). 

Regarding claim 5, Hyon and Balier do not explicitly teach a display device 
comprising: 

A) wherein said text attribute data contains decoration attribute data indicating a type of 
a decoration applied to a corresponding text; and 
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B) said image transforming means decorates said registered image according to said 
decoration attribute data. 

Ostermann, however, teaches "wherein said text attribute data contains 
decoration attribute data indicating a type of a decoration applied to a 
corresponding text" as "The sender can associate typed words with an emoticon by 
underlining, coloring, highlighting, or by any other means... In this case, in a sentence 
such as "Hi John, :-) are vou pleased that the stock market is up ?" the underlining 
represents the highlighting wherein the sender chooses to begin the smile at the 
beginning of the word "are" and to continue the smile through the word "up". The 
method comprises receiving the indicated duration of the emoticon and presenting the 
chosen duration of the emoticon" (Column 11, lines 43-61) and "said image 
transforming means decorates said registered image according to said 
decoration attribute data" as "The sender can associate typed words with an 
emoticon by underlining, coloring, highlighting, or by any other means... In this case, in a 
sentence such as "Hi John, :-) are vou pleased that the stock market is up ?" the 
underlining represents the highlighting wherein the sender chooses to begin the smile at 
the beginning of the word "are" and to continue the smile through the word "up". The 
method comprises receiving the indicated duration of the emoticon and presenting the 
chosen duration of the emoticon" (Column 1 1 , lines 43-61 ). 

It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to combine the teachings of the cited references because teaching 
Ostermann's would have allowed Hyon's and Baker's to provide a method to allow 
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the ability to insert a customized emoticon or specified image by a single button click, as 
noted by Ostermann (Column 3, lines 35-54). 

Regarding claim 9, Hyon and Baker do not explicitly teach a display device 
comprising: 

A) wherein said transforming means includes image decoration means for decorating 
said registered image to provide continuous decoration to both said registered image 
and neighboring characters adjacent to said registered image according to said 
decoration attribute data. 

Ostermann, however, teaches ''wherein said transforming means includes 
image decoration means for decorating said registered image to provide 
continuous decoration to both said registered image and neighboring characters 
adjacent to said registered image according to said decoration attribute data" as 
"The sender can associate typed words with an emoticon by underlining, coloring, 
highlighting, or by any other means... In this case, in a sentence such as "Hi John, >) 
are vou pleased that the stock market is up ?" the underlining represents the highlighting 
wherein the sender chooses to begin the smile at the beginning of the word "are" and to 
continue the smile through the word "up". The method comprises receiving the 
indicated duration of the emoticon and presenting the chosen duration of the emoticon 
as the animated entity delivers the message. As mentioned above, the highlighting can 
occur through coloring words, underlining words, or some other means of presenting the 
emotion" (Column 1 1 , lines 43-61 ). 
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It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Ostermann's would have allowed Hyon's and Baker's to provide a method to allow 
the ability to insert a customized emoticon or specified image by a single button click, as 
noted by Ostermann (Column 3, lines 35-54). 

Regarding claim 10, Hyon and Baker do not explicitly teach a display device 
comprising: 

A) wherein said image decoration means decorates said registered image, such that 
both said registered image and said neighboring characters show the said fore and 
back colors continuously. 

Ostermann, however, teaches "wherein said image decoration means 
decorates said registered image, such that both said registered image and said 
neighboring characters show the said fore and back colors continuously" as The 
increased intensity of the emoticon may be accomplished by changing the icon from 
black-on-white background to black-on-colored background (such as red or yellow) 
where the intensity of the background color reflects the amplitude" (Column 9, lines 43- 
67) and "The sender can associate typed words with an emoticon by underlining, 
coloring, highlighting, or by any other means... In this case, in a sentence such as "Hi 
John, :-) are you pleased that the stock market is up ?" the underlining represents the 
highlighting wherein the sender chooses to begin the smile at the beginning of the word 
"are" and to continue the smile through the word "up". The method comprises receiving 
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the indicated duration of the emoticon and presenting the chosen duration of the 
emoticon as the animated entity delivers the message. As mentioned above, the 
highlighting can occur through coloring words, underlining words, or some other means 
of presenting the emotion" (Column 1 1 , lines 43-61 ). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Ostermann's would have allowed Hyon's and Baker's to provide a method to allow 
the ability to insert a customized emoticon or specified image by a single button click, as 
noted by Ostermann (Column 3, lines 35-54). 

Regarding claim 1 1 , Hyon and Baker do not explicitly teach a display device 
comprising: 

A) wherein said image decoration means decorates said registered image to draw a 
continuous underline below both said registered image and said neighboring characters. 

Ostermann, however, teaches "wherein said image decoration means 
decorates said registered image to draw a continuous underline below both said 
registered image and said neighboring characters" as "The sender can associate 
typed words with an emoticon by underiining, coloring, highlighting, or by any other 
means... In this case, in a sentence such as "Hi John, :■) are vou pleased that the stock 
market is up ?" the underlining represents the highlighting wherein the sender chooses 
to begin the smile at the beginning of the word "are" and to continue the smile through 
the word "up". The method comprises receiving the indicated duration of the emoticon 
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and presenting the chosen duration of the emoticon as the animated entity delivers the 
message. As mentioned above, the highlighting can occur through coloring words, 
underlining words, or some other means of presenting the emotion" (Column 1 1 , lines 
43-61). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Ostermann's would have allowed Hyon's and Baker's to provide a method to allow 
the ability to insert a customized emoticon or specified image by a single button click, as 
noted by Ostermann (Column 3, lines 35-54). 

Regarding claim 12, Hyon and Baker do not explicitly teach a display device 
comprising: 

A) wherein said image decoration means decorates said registered image to draw a 
continuous cancel line on both said registered image and said neighboring characters. 

Ostermann, however, teaches "wherein said image decoration means 
decorates said registered image to draw a continuous cancel line on both said 
registered image and said neighboring characters" as The sender can associate 
typed words with an emoticon by underlining, coloring, highlighting, or by any other 
means... In this case, in a sentence such as "Hi John, :-) are vou pleased that the stock 
market is up ?" the underlining represents the highlighting wherein the sender chooses 
to begin the smile at the beginning of the word "are" and to continue the smile through 
the word "up". The method comprises receiving the indicated duration of the emoticon 
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and presenting the chosen duration of the emoticon as the animated entity delivers the 
message. As mentioned above, the highlighting can occur through coloring words, 
underlining words, or some other means of presenting the emotion" (Column 1 1 , lines 
43-61). 

The examiner notes that it is clear that Ostermann's method can use various 
computer font techniques to apply to sentences with emoticons, such as underlines and 
highlighters. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because teaching 
Ostermann's would have allowed Hyon's and Baker's to provide a method to allow 
the ability to Insert a customized emoticon or specified image by a single button click, as 
noted by Ostermann (Column 3, lines 35-54). 

Response to Arguments 
10. Applicant's arguments filed on 12/1 1/2006 have been fully considered but they 
are not persuasive. 

Applicant goes on to argue on pages 2-3, that "Hyon does not state that 
emotions are not stored in the storage 18 beforehand and are stored externally by 
a user... Therefore, Hyon fails to disclose or suggest the "second storage portion" 
as recited in claim 1". However, the examiner wishes to point to paragraph 44 of 
Hyon which states "In another embodiment, the user can add hieroglyphics to basic 
emoticons stored by a manufacturer The hieroglyphics can be stored in three ways: 
the user directly stores them, receives them from a base station, and the stores them, or 
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downloads them from the Internet" (Paragraph 44). The examiner further wishes to 
state that it is clear that a user can download emoticons to a mobile terminal from 
external storage (see "intemet" and "base station") 

Conclusion 

1 1 . The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

U.S. Patent 6,987,991 by Nelson on 17 January 2006. The subject matter 
disclosed therein is pertinent to that of claims 1-8 (e.g., methods automatically scale 
graphics into a text sentence that is sent to another user). 

U.S. PGPUB 2002/0120653 by Kraft et al. on 29 August 2002. The subject 
matter disclosed therein is pertinent to that of claims 1-8 (e.g., methods automatically 
scale graphics into a text sentence that is sent to another user). 

U.S. Patent 6,584,479 by Chang et al. on 24 June 2003. The subject matter 
disclosed therein is pertinent to that of claims 1-8 (e.g., methods automatically scale 
graphics into a text sentence that is sent to another user). 

U.S. Patent 6,456,305 by Qureshi et al. on 24 September 2002. The subject 
matter disclosed therein is pertinent to that of claims 1-8 (e.g., methods automatically 
scale graphics into a text sentence that is sent to another user). 

1 2. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 

§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 
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A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

Contact Information 

1 3. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Mahesh Dwivedi whose telephone number is (571 ) 272- 
2731 . The examiner can normally be reached on Monday to Friday 8:20 am - 4:40 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Tim Vo can be reached (571 ) 272-3642. The fax number for the 
organization where this application or proceeding is assigned is (571) 273-8300. 

Infonnation regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status Information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see httD://Dair-direct.uspto.Qov . Should 
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you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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